Exploring reliability heterogeneity with multiverse analyses: Data processing decisions unpredictably influence measurement reliability

Reliability Analyses of Open Government Data

Public authorities are increasingly sharing sets of open data. These data are often preprocessed (e.g. smoothened, aggregated) to avoid to expose sensible data, while trying to preserve their reliability. We present two procedures for tackling the lack of methods for measuring the open data reliability. The first procedure is based on a comparison between open and closed data, and the second de...

Modeling analyses and data in human reliability

Making Decisions with Unknown Sensory Reliability

To make fast and accurate behavioral choices, we need to integrate noisy sensory input, take prior knowledge into account, and adjust our decision criteria. It was shown previously that in two-alternative-forced-choice tasks, optimal decision making can be formalized in the framework of a sequential probability ratio test and is then equivalent to a diffusion model. However, this analogy hides ...

Susceptibility and Measurement Reliability

In this chapter, we report the concept and results of an empirical study that explored the effects of immersion and pictorial realism on the sense of presence in a virtual environment (VE). The VE used was similar to a typical industrial application. Seventy-seven participants each experienced one of four settings with varied combinations of immersion and pictorial realism, displayed in a proje...

Optimal Reliability Allocation with Discrete Cost-Reliability Data for Components

This paper addresses the optimal allocation of reliability among components that are to be assembled into a system. While it is a generally accepted notion that a component's cost is an increasing function of its reliability, most research to date adopts exponentially increasing, closed-form functions to relate cost and reliability. However, in practice such functions are often unknown or diffi...